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ABSTRACT / 

A survey was conducted of more than 300 instructional 
developers, asking which books t*he-y would recommend for a variety of 
different uses. To assist them, a. listing of 1<39 instructional 
development books taken from a recent journal article was included 
with the survey. Participants, who represented a diverse but 
highly-experienced group, were asked to recommend three books for 
each of four categories: personal use, textbook, reference for 
practitioners, and for reading by nondeveloper s . A list of most 
recommended books was developed, and demographic variables were used 
in the analysis of respondent recommendations. Results, though 
inconclusive, indicate* that significant differences exist in book 
recommendations according to such factors as sex^ age, and other 
demographic variables and suggest areas for further analysis and 
research. This report includes tables displaying data on respondents' 
job "responsibilities, years of experience, and places of employment; 
the 39 most-recommendted books; additional book recommendations; and 
topics for new books suggested by respondents. Forty references are 
listed., (LMM) 



AUTHOR 
TITLE 
PUB. DATE 
NOTE 



PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



4 

> 




9 



************************ *********************************************** 

* Reproductions supplied by EDRS are'the,best that can be made * 

* from the original document. * 
************************************** ********************************* 



ERIC 



BASIC REFERENCES DN INSTRUCTIONAL DEVELOPMENT 



Papgr presented at the Annual Meeting, 
Association for Educational Communications and Technology, 

New Orleans, Louisiana, 

January 21, 1983 

& . 

U.S. DEPARTMENT OF EDUCATION 

NATIONAL INSTITUTE OF EDUCATION 

EDUCATIONAL RESOURCES INFORMATION 
: CENTER (ERIC) 

Pi This document has been reproduced as 
received from the person or organization 
\ originating H 

Minor changes have tjecn made to improve 

reproduction guafrty ft " 

• Points of view or opinions slated in this docu 
ment do not necessarily represent official NlE 
position or policy 



Roberts A. Braden ^ 
Learning Resource's Center 
Virginia Tech 
Blacksburg , Virginia 24061 



and 
A 

Steven G. Sachs 
Extended Learning Institute 
Northern Virginia Community College 
Annandale , Virginia 22152 

0 



-PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BFIEN GRANTED BY 

Roberts- A. Braden 



TO THE EDUCATIONAL RESOURCES 
INFORMS CENTER (ERIC).*" 



abridged yersion of this paper has been accepted for publication 
in Educational Technology under the title 
"The Most Recommended Books on ^Instructional -Development" 



ERIC 



ABSTRACT ' 

'This paper reports on a survey of more than 300 instructional develop- 
ers who were ar*ked which books they would recommend for a variety of 
different uses. Tu assist them, a listiu L39 books taken from 

a recent Jtxitnal article was included with suryey. The respondents 

represented a diverse but highly experienced O roup. Participants were 
agked to recpmmend^ three books for each of four categories: personal 
^use, textbook, reference for practitioners, , and for reading by non- 

.developers. A list of most recommended books was developed, ^and demo- 
, ; graphic variables wereused in the analysis of respondent recommendations. 

- I — , X. 

In the past few years it has been popular to. develop bibliographies of 

books on instructional development. Hgwever, for the most part, these bibli- 

*» - ' 

ographies Jiave been the result of one individual or perhaps a small group de- 

• ciding arbitrarily what should or should not be included on a list. Little 

i 

attempt has Veen made to verify the utility of these choices for users in the 

i 

■ field. 

* The purpose of .cixis study was to conduct a na tior "vey of instruc- 

• H - ' 

ticmal developers, askinjg for recommendations about the books of the field. 
The results were expected to reflect any consensus opinions held by the users 
regarding the utility of the identified literature. The v^vy nature vof the 
surv/ey was expected to result in the omission of a variety <j£ specialized 
res^H^ces that might be useful in certain settings. Even so, the desired 

results of the study were not limited to the development a new, perHaps 

*" \ \ 

shorter bibliography. Instead, it was trtfought^ that m^ich could be learned by 

■y . 

examining the pattern- of responses to questions about ID books. The authors 

' ' >" ^ . ■ 

began with high hope that the results might help to identify which ID approaches 

a 

are most useful, who the conceptual leaders of the field are, and what networks 
among authors exist. t & 

/ 

The field of ID is characte _z. by wide diversity.' • .ud o« . is the 1 
result of the settings in which ID is practiced. Some of it is the result of j - 
differences among graduate ID programs. Some of it is the result of differences 
among philosophical approaches to education and training. While books are only 

3 



a part of the literature on ID, they should be representative of most or all 

.a' $ * 

of the theoretical and conceptual ideas upon which the field is founded. This 

f ■■ ■ 4 

study was designed to be a first step in identifying some of the common themes ^ 
and common pp r ivergence that typify ID toda^ T ^sucfy, this stu4y . 

anticipates the need for future analysis .of the p^jLiotfic literature of the field. 



THE METHOD r . 

Selecting, the Samplp .' No one i^really sure how m ^j^ ^ nstruc ^ ona ^ developers • 
there are. In fac^^here is^tfotT^even an agreed?#Ctpon method for distinguishing 
between professional instructional developers (whatever "professional" means) 
and others in the Education a%d training field who have adopted the ID title. ; 
Our goal was to identify survey participants who would be knowledgeable about/ - 
ID literature.. We also sought respondents whose claim to the ins true tibnal . , 
developer' title was based upon some ac tual^expeyience doing ID either full-: v 
time or part-time. T accomplish this, k sample of 306 was selected from 
past or present members of the Division for "Instructional- Development of- the * m 
Association for Educational Communi captions and Technology. To provide a high 
probability that the individuals were primarily involved in some aspect X)f, ID, 
address indicators^ such as job titles and unit^names were used In selecting 
the sample. 4 «. - . , 

Analysis of Respondents. A* total of 1 26^ response^ (41 . 2%) were, returned. Ten 

*■ • * ^ * Vjj 

responses had .to be discarded bebause they did not provide enough usable data. ♦ 
Of the remaining L16 survey forms, '74% were from men, 2&% from women. \ Because 
the initial impetus for this study came' fjrxmi a perceived need to obtain user 
verification of a list of ID books, particular attention was given to analysip^ 

- • * * / 

of che respondent population. J Thoug not Jiece^sarily scientifically represen- 



tative of all instructional developers the respondents represented a diverse^ 



highly experienced group^as illustrated' in tables 1-3. 



< 



Table 1 

Respondents 1 Job Responsibilities 
(listed in declining order of frequency) 



> 

Job Responsibility Percentage 

Part-tim6 Developer - , 53% 

ID Instruc-tor^of Graduate Students 46% 

ID Project Evaluatof 38% 

ID Program Administrator - 34% 

ID Support Service 33% 

Full-time Developer 14% 

ID Instructor: Industry or Government 10% 

f > 

ID Instructor of Undergraduate Students ■ 9% 

' Table 2 



Years of Respondent Experience 
v 

/ 



Years 



Direct ID Experience * 0. 1-3 4-6" 7-9 10+ 

(prac titioner) N = 110* J<r 

Full-time (74) ' . 33%. 16# 19% 13% \ 19% 

Parr-time (63)7 N 43% 20% 12% 8% h% 



Training Developers or 
Teaching ID N = 116 



Full-time (45) 




61% 


7% 


11% * 5% 


15% 


^art-time (41) 


O 


65% 


16% 


6% 4% 


9% 


ID Related Experience 




16% 


6% 


14%* 12% 


.51% 


0 




t 









*A11 116 respondents j_ ve intokiati - which "Indicated 
past or present ID experience— ^full-time , ^part-time , 
or both^. However, 6 persons did not respond directly 
to years of£ Experience , and their replies were not 
used in these computations. 



T4bJ.e 3 • - 

Respondents' Places of Employment 
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Place of Employment , m Per centage 

Public College ^ 66% 
Private College 11% 
Consulting firm 9% 
a Self-employed^ . : ' 8% - 

Industry ' 8% 

tea ' 

Community or Junior College # 8%* 

i ■ 

All other categories 11% * 

(Total exceeds 100% due to multiple responses.) 



A total of 964 years of full-time or part-time ID experience %as re- * 
ported by 110 individuals. Similarly, 93 people reported a total or 1127 . 

* • / 

years of ID-related experience. The predominance of college sta£c ,and 
faculty (85%) is mirrored in the finding that the vast majority of those 
responding (8 9 %^ 1 1 doctoral degrees. (The low response by • < 't- 
side of academia was a disappointment.) The majority (71%' ''■r 1 '* 

■ ) \ 

swering^the surVey had taken Educational Technology or ID coursework as a ^ 
major, with courses taken ^at 56 colleges and universities from around the 
country. " In spite of this heavy concentration ^of *£.ollega faculty, experi- ' 
enced prof essionals * and Ed Tech/ID majors, one^ third reported having 1 ex- 

amined or read only a little of the litera^tur^ li in the reference 

i 

and only 10% reported having ^examined or read almost all of it. 
To verify the geographic ' dispersion of subjects, the, envelopes in which 
the questionnaires were returned were checked for postmarle£\ Of 108 rea4^ble 
postmarks from 37 states and the District of Columbia, the most were from ^ 
Florida (9) , Illinois (9), Texas CQ), r- m ' * ^ennsylv a (7). 



The Survey , Instrument . Each of the, 306 members of the sample^was 'sent 
questionnaire of 2 pages, iegal size, with 17 questions (§ee Appendix). Half 
of the questionnaires were printed on" green paper, half on yellow. All of 

e 

the sample received the 139 item book list (Braden, 1982) which had originally 
been printed in Educational Technology . The half ^ the sample (152 persons) 
who received green questionnaires were also given a second list which con- 
tained names of 61 other books. Botl^ book lists are inclu^ed^in the appendix. 
Procedures. From each returfS€r(F questionnaire 74 items of information were 
coded 'onto an optical scan sheet. The ooded opscan sheets were then read into 
a computer data base and v an initial tabulation was run to determine which 
demograpbic questibns had elicited response patterns^ suitable for cross-break 
analysis of respondent book recommendations. The 16 most frequently recom- 
mended bo^ks were also identified and were used thereafter in the statistical 
analysis. 



RESULTS 

Supplements l^ook List, Whether a supplementary bo^ 1 list was inc^-'M v/ith 
tht, questionnaire and basic book list made no difference in response rate (64 
for both lists vs. 62 for basic list only). However, eight of the. ten responses 
that were unusable because insufficient data was furnished came from subjects, 
who received only the basic book list. 

Book Recommendations. Each participant in the survey, was asked to recommend 

three books from the Braden article for each* of four categories: personal use, 

t 

textbook, reference for practicing developers, and reading for a client not 

> ■ 

knowledgeable about ID. One or more vofes were cast for -94 of the books on 
the list of 139. „ Main results of the selection aspect of the survey au shown 
In Table 4. 



Tabled 4 ■ 

-The Most Recommended Books - 

. Rank by Number of". Recommendations 

Author i Short Title , Own x Text Reference Client Overall' 
3 ' " ' ' / 

AECT. Educational Technology: Glossary . - , 10 - - 

Bloom. A Taxonomy of Educational 

Objectives . . 8 - 5 - 10 

— ; * 

Briggs. Instructional Design . 4 3 7 . 6 3 

Briggs & Wager. 7 , Handbook of 

Procedures . % - 5 6 9.7' 

Davies. Competency Basfed Learning . - - - 10 - 

Davis, Alexander, & Yelon. « 

Learning System Design . « 7 6 - 5 8 

Diamond. Instructional Development 

for Individualized Learning . - 10 - 8 

Dick & Carey. The System'atic Design 

of Instruction . 9 2 4 6 

Fleming & Levxe. Instructional 
Message Design . * 

Gagne. The Conditions of Learning . 

Gagne & Briggs. Principles of h • \ - 

Instructional Design . 1 1 1 3-1 

Heinich. Technology and the 

Management of Instruction . 10 ^ 

Tin. ^ = ' 7 c 'i" •. ior^as of Learning . - 9. 

Keit.. instructional Design . - 9 - ' 2 "V 9 

Mager/ Preparing Instructional , 

Objectives . , 5 8 8 15 

Travers. Second Handbook of Research 

' on Teaching . 6 ' 4 - - 

Other books recommended by 10% or more of the respondents: 

AECT Task Force on Definitions and Terminology. The Definition of Educational 
Technology ; Baker & Schutz, eds. Instructional Product Development ; Banathy, 
Instructional Systems ; Bass, Lumsden, & Dills, eds. Instructional Development : 
The State of the Art ;' Bloom, Madaus, Hastings, Evaluation to Improve Learning ; 
Gagne, Essentials of Learning for Instruction ; Merrill, ed nstruc tional Design : 
Readings ; Merrill & Tennyson, Teaphi.n^ — ept An lustruc onal Design Guide ; 
Postlethwait & Associates Ujriug ^ehing Alternatives ; Salomon, Interaction 

of Media, Cognition, and 'Learning ; Snelbecker, Learning Theory, Instructional Theory 
and Psychoeducational Design ; Wittich & Schuller, Instructional Technology: Its 
Nature and Use (Sixth Edition). 1 \ 



3-7 2 - 4^ 

2 4 * 3 7 2 
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There is much duplication in\ selection from category to category. The 
top ten choices in all four categories* are covered by only 16 books. An addi- 
tional 13 books were recommended for^epe or <hore categories bjy 3,0% or more of 
the respondents. Of these 29 highly selec ted books, four were in tfie top ten- 
for all categories: ^ Prihciples of Instructional Design by Gagne & Briggs, The 
Conditions of Learning by Gagne, Instructional Design edited b^Briggs, and 
Handbook of Procedures for the Design of Instruction by Briggs*& yager. The 
dominant influence of Gagne & Briggs is hard to ignore, with their, book Princi 
. pies of Instruc tional Design recommended as a textbook by .^over 40% of all re- 

• i ' ' • • - ' 

spondents. This was the highest r agreement on any' recommendation in the survey 

In addition to the list of ^J9^bboks included in 'the survey, respondents 
were given an opportunity to list othe»^*^oks-.that would-be appropriate for 
a basic ID reference shelf. ^ 9 other b^pks w^e named.. Table 5 

lists the most frequently reco. tded. 



Table 5 r • 
Additional Be j': Recommendations a - #4 

Gerlaoh & Ely. Teaching and Media *. * * ;j 

or } v , i 

Gilbert. Human Competence. 

■ • % 

. t . • • ■ 

Hartley. Designing Instructional Text ?- 

- i 

inich, Molenda, & Russell. Instructional Media & 
i'he New Technologies of Instruction . 

jQnassen. The Xechnology^ of Text . 

Kemp. Planning & Producing Audio-Visual' Material s, 
"^a ge r . Goal Analysis ? 

Markle. Designs f or x Instruc tional Designers . 
Romiszowski. Designing Instructional Systems . 
Wileman. Exercises in Visual Thinking. * 
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Book Deletions .' Another aspect of the study was to identify books that were 
1 no longer appropriate for a 'basic ID reference shelf. Reasons for such a 
deletion might involve^age, topic, cost, readability etc. Of the 139 books 
on the survey list, 81 received~"at- least one nomination for de/letion. A few 
of the negative expressions were strongly stated. However, no clear cut case 
emerged for deleting any book from the list, ^hougtv seven did receive more 
recommendations for deletion than for inclusion as one of the top three »in. a 
category. An additional 26 books received neither recommendations as a top 
* book nor recommendations f or deletion. 

Topics for New Books. «In addition to making judgements about specific books 

' ' 

-in the ID field, the respondents were asked to indicate topics about which 

/ 



they wc 
"and su 



uld like to see new books published. The results are shown in Table 6 
est that the individuals who responded to this survey have a greater 



interest in the application of learning theory and other research findings 
\thaii in 5 procedures and strategies for doing ID. Keep in mind, however, that 
cpllege faculty made up the majority of participants in the survey. Research ( 



and theory are topics which on<f^ld_expec t to be of greater interest to 
academics ttian to instructional developers. 

Table* 6 

i 

Topics for New Books 

k 

Topic . Rank & 

- Applying Learning Theory to ID 1 
. Research Related to ID 

Designing Instructional Strategies 
practical ID Tips 

ID for Business and Industry 5 f 

Fror^t-end Analysis 

Formative Evaluation -7 . V 
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2 

3 , 
4 
5 

I 

6 ' 

Designing Instructional Material 

Teac ning Ins true tion^al Evaluatoon- 

v ■ s * 

ID (((ienera^ ^ , 10 

J 



s 

9 /. 



Responses 

54% , , 
45% 
31% 
29% 
2&% 
, 27% 
25% 
21% 
17% 
14% 
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Observations . The su^^ generated an extensive data bank of significant 
an<J non-signi£icant facts which offer innumerable tidbits of information that 
will be useful in further studies of the literature and its relationship to 
the field of instructional development. For example: 

- i 

• Men were significantly more apt to select Principles of Instructional 

■* ' r ■ ; — * — 

/ Design (Gagne & BriggsJ for personal use and as a reference than women 
(43% vs. 17%- and 22% vs. 10%). » « 

• s Women were almost twice as likely as men to recommend The Conditions 
of Learning <Gagne) as a text (24% vs. 13%). Men, however, recommended 
/ ' it twice as often as womei^ to give to clients (13% vs» 7%) and three 
times as often as a reference (23% vs. 7%). 
. • Men were significantly more apt than women to select Ins true tional 
Design (Briggs) as a. text (22% vs. 3%).* " ■ 

• Respondents who majored in Ed Tech or Ili were more than twice as 
likely as all others to selec t, Instruc tional Message Design (Flem^ig 
& Levie) as a reference (22% vs. 9%). 

o Only 8% r of College level developers selected Preparing Instrutg^onal ; 
Objectives (M^ger) ais^ a bqok .tro own for personal use* as compared with 
31% of all oth ers . Those under 40 years old recommeiKled it for clients 
twice as often as those over 40 (31% vs. 15%). 

1 , DISCUSSION 

The initial analysis of the data from this survey can hardly explain why 

( 

significant differences exist for such factors as sex, age, and other variables. 
It, does suggest areas' for further analysis an^ f uturd^rdsearch. Not surprising- 
ly, additional Analysis will be needed to synthesize what the t recommended books 
say about the actual practice of ID and to identify the . invisible networks that 
prqvide the theoretical and conceptual framework upon which the practice of ID 
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is fcased. The rather limited agreement on the top books should not be taken 
to imp'ly that' the field should *be based on such- a limited foundation. * ; .< 

A number of indications from this study suggest that most developers have ^ 
a relatively narrow perspective and limited experience with -the Variety of , J 
literature available. T^he majority of the 16 books most recogimended are more 
than seven ^ears old. While a~wide range of responses was expected and, in *' t - 
fact, did occur with 193 -different -books receiving at leasts one recoramendar *• f 
tibn, if seems surprising that so few received recommendations from several 
persons. (Only 63 books were recommended by four or more people;. 

While the results of this survey are hardly conclusive, they ' do raise 
some disturbing questions about instructional development and how far the field 
has come as a profession. Has the field become so specialized that, each deveJL^ 
oper truly has unique literature needs? Is there -a' failure to. base the practice' 
of ID on a solid theoretical foundation as' chronicled in the books of the field? 
Is ID an art developed almost entirely through personal, experience? ^Lt' seems 
unlikely that these questions have affirmative answers , .but that is- one. way of ^ 



interpreting these findings. Other reactions would be to conclude ttxat it is 
too early to judge the literature of the ID field or that any ' agreement about ( 



the literature' (^nd there was some) is an important step for involving pro- 




fession. Certainly, the >39^most recommended books as revealed by tfcis survey ' 



* 



are all excellent (see references). Taken as a whole "they represent a funda- 

> \ • 

mental and growing core of basic literature lor instructional development.. ' 



12 • I 
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